Overview

Dataset statistics

Number of variables18
Number of observations2151
Missing cells4303
Missing cells (%)11.1%
Duplicate rows0
Duplicate rows (%)0.0%
Total size in memory288.7 KiB
Average record size in memory137.4 B

Variable types

NUM9
CAT6
UNSUPPORTED2
BOOL1

Reproduction

Analysis started2020-05-21 15:05:52.294922
Analysis finished2020-05-21 15:06:05.594872
Duration13.3 seconds
Versionpandas-profiling v2.8.0
Command linepandas_profiling --config_file config.yaml [YOUR_FILE.csv]
Download configurationconfig.yaml

Warnings

number_of_reviews has constant value "0" Constant
name has a high cardinality: 2003 distinct values High cardinality
host_name has a high cardinality: 579 distinct values High cardinality
id is highly correlated with df_indexHigh correlation
df_index is highly correlated with idHigh correlation
neighbourhood is highly correlated with neighbourhood_groupHigh correlation
neighbourhood_group is highly correlated with neighbourhoodHigh correlation
last_review has 2151 (100.0%) missing values Missing
reviews_per_month has 2151 (100.0%) missing values Missing
name is uniformly distributed Uniform
df_index has unique values Unique
id has unique values Unique
last_review is an unsupported type, check if it needs cleaning or further analysis Unsupported
reviews_per_month is an unsupported type, check if it needs cleaning or further analysis Unsupported

Variables

df_index
Real number (ℝ≥0)

HIGH CORRELATION
UNIQUE

Distinct count2151
Unique (%)100.0%
Missing0
Missing (%)0.0%
Infinite0
Infinite (%)0.0%
Mean5406.978614597861
Minimum18
Maximum7906
Zeros0
Zeros (%)0.0%
Memory size16.8 KiB

Quantile statistics

Minimum18
5-th percentile1314.5
Q14143
median5866
Q37105.5
95-th percentile7797.5
Maximum7906
Range7888
Interquartile range (IQR)2962.5

Descriptive statistics

Standard deviation2015.913291
Coefficient of variation (CV)0.3728354473
Kurtosis-0.2194555785
Mean5406.978615
Median Absolute Deviation (MAD)1423
Skewness-0.7847043048
Sum11630411
Variance4063906.395
Histogram with fixed size bins (bins=10)
ValueCountFrequency (%) 
61431< 0.1%
 
75631< 0.1%
 
54861< 0.1%
 
34391< 0.1%
 
68481< 0.1%
 
75411< 0.1%
 
75431< 0.1%
 
75451< 0.1%
 
55001< 0.1%
 
75491< 0.1%
 
Other values (2141)214199.5%
 
ValueCountFrequency (%) 
181< 0.1%
 
231< 0.1%
 
261< 0.1%
 
291< 0.1%
 
361< 0.1%
 
ValueCountFrequency (%) 
79061< 0.1%
 
79051< 0.1%
 
79041< 0.1%
 
79031< 0.1%
 
79021< 0.1%
 

id
Real number (ℝ≥0)

HIGH CORRELATION
UNIQUE

Distinct count2151
Unique (%)100.0%
Missing0
Missing (%)0.0%
Infinite0
Infinite (%)0.0%
Mean29489562.23059042
Minimum355955
Maximum38112762
Zeros0
Zeros (%)0.0%
Memory size16.8 KiB

Quantile statistics

Minimum355955
5-th percentile11505047.5
Q125793856
median32224108
Q335656696
95-th percentile37899069.5
Maximum38112762
Range37756807
Interquartile range (IQR)9862840

Descriptive statistics

Standard deviation8199213.277
Coefficient of variation (CV)0.2780378092
Kurtosis1.484029242
Mean29489562.23
Median Absolute Deviation (MAD)4152764
Skewness-1.36544138
Sum6.343204836e+10
Variance6.722709836e+13
Histogram with fixed size bins (bins=10)
ValueCountFrequency (%) 
228904951< 0.1%
 
372606511< 0.1%
 
297055501< 0.1%
 
213988661< 0.1%
 
47220051< 0.1%
 
357752381< 0.1%
 
273462641< 0.1%
 
297314891< 0.1%
 
378770861< 0.1%
 
239076791< 0.1%
 
Other values (2141)214199.5%
 
ValueCountFrequency (%) 
3559551< 0.1%
 
4817891< 0.1%
 
6426601< 0.1%
 
7338631< 0.1%
 
7683131< 0.1%
 
ValueCountFrequency (%) 
381127621< 0.1%
 
381104931< 0.1%
 
381093361< 0.1%
 
381082731< 0.1%
 
381051261< 0.1%
 

name
Categorical

HIGH CARDINALITY
UNIFORM

Distinct count2003
Unique (%)93.1%
Missing0
Missing (%)0.0%
Memory size16.8 KiB
Tasteful & Cozy 1 BR near SGH/Tiong Bahru
 
8
City-located 1BR loft apartment *BRAND NEW*
 
8
MODERN 2 BR APT @ CENTRAL/GEYLANG w/QUEEN BED
 
6
Stylish 1BR Located 7 mins from Tg Pagar MRT
 
5
Inviting & Cozy 1BR APT 3 mins from Tg Pagar MRT
 
5
Other values (1998)
2119
ValueCountFrequency (%) 
Tasteful & Cozy 1 BR near SGH/Tiong Bahru80.4%
 
City-located 1BR loft apartment *BRAND NEW*80.4%
 
MODERN 2 BR APT @ CENTRAL/GEYLANG w/QUEEN BED60.3%
 
Stylish 1BR Located 7 mins from Tg Pagar MRT50.2%
 
Inviting & Cozy 1BR APT 3 mins from Tg Pagar MRT50.2%
 
Tasteful & Cozy 1 Bedroom Apt near SGH/Tiong Bahru40.2%
 
KINEX/GEYLANG SERAI/EUNOS MRT "MODERN LOFT APT"40.2%
 
Tasteful & Cozy Exe 1-BR Apt near SGH/Tiong Bahru40.2%
 
City-located studio loft apartment *BRAND NEW*40.2%
 
Gem of the West 1BR APT 3 mins from Jurong E MRT40.2%
 
Other values (1993)209997.6%
 

Length

Max length92
Median length42
Mean length38.9986053
Min length1

host_id
Real number (ℝ≥0)

Distinct count690
Unique (%)32.1%
Missing0
Missing (%)0.0%
Infinite0
Infinite (%)0.0%
Mean122111404.43654114
Minimum228867
Maximum288567551
Zeros0
Zeros (%)0.0%
Memory size16.8 KiB

Quantile statistics

Minimum228867
5-th percentile8492007
Q133267200
median111909043
Q3209260798
95-th percentile267763952
Maximum288567551
Range288338684
Interquartile range (IQR)175993598

Descriptive statistics

Standard deviation87335732.01
Coefficient of variation (CV)0.7152135577
Kurtosis-1.321337745
Mean122111404.4
Median Absolute Deviation (MAD)82488190
Skewness0.1983563524
Sum2.626616309e+11
Variance7.627530085e+15
Histogram with fixed size bins (bins=10)
ValueCountFrequency (%) 
664061771095.1%
 
2099138411085.0%
 
219550151743.4%
 
8492007683.2%
 
159804766663.1%
 
201034613643.0%
 
156409670612.8%
 
138649185612.8%
 
108773366452.1%
 
151196270422.0%
 
Other values (680)145367.5%
 
ValueCountFrequency (%) 
2288671< 0.1%
 
22933930.1%
 
5194721< 0.1%
 
5810331< 0.1%
 
64662940.2%
 
ValueCountFrequency (%) 
2885675511< 0.1%
 
2885462011< 0.1%
 
2882499751< 0.1%
 
2881104671< 0.1%
 
28801651920.1%
 

host_name
Categorical

HIGH CARDINALITY

Distinct count579
Unique (%)26.9%
Missing0
Missing (%)0.0%
Memory size16.8 KiB
Jay
 
112
Richards
 
108
Alvin
 
76
Rain
 
74
Xiaoyu
 
66
Other values (574)
1715
ValueCountFrequency (%) 
Jay1125.2%
 
Richards1085.0%
 
Alvin763.5%
 
Rain743.4%
 
Xiaoyu663.1%
 
Marcelo643.0%
 
Rajan612.8%
 
Paridhi612.8%
 
RedDoorz452.1%
 
Jhian422.0%
 
Other values (569)144267.0%
 

Length

Max length35
Median length5
Mean length6.062296606
Min length1

neighbourhood_group
Categorical

HIGH CORRELATION

Distinct count5
Unique (%)0.2%
Missing0
Missing (%)0.0%
Memory size16.8 KiB
Central Region
1764
West Region
 
116
East Region
 
108
North-East Region
 
88
North Region
 
75
ValueCountFrequency (%) 
Central Region176482.0%
 
West Region1165.4%
 
East Region1085.0%
 
North-East Region884.1%
 
North Region753.5%
 

Length

Max length17
Median length14
Mean length13.74058577
Min length11

neighbourhood
Categorical

HIGH CORRELATION

Distinct count39
Unique (%)1.8%
Missing0
Missing (%)0.0%
Memory size16.8 KiB
Geylang
310
Kallang
290
Novena
 
202
Bukit Merah
 
163
Rochor
 
131
Other values (34)
1055
ValueCountFrequency (%) 
Geylang31014.4%
 
Kallang29013.5%
 
Novena2029.4%
 
Bukit Merah1637.6%
 
Rochor1316.1%
 
Downtown Core1245.8%
 
Outram1115.2%
 
Queenstown843.9%
 
River Valley803.7%
 
Bedok773.6%
 
Other values (29)57926.9%
 

Length

Max length23
Median length7
Mean length8.470943747
Min length5

latitude
Real number (ℝ≥0)

Distinct count1808
Unique (%)84.1%
Missing0
Missing (%)0.0%
Infinite0
Infinite (%)0.0%
Mean1.3143614644351465
Minimum1.24387
Maximum1.45328
Zeros0
Zeros (%)0.0%
Memory size16.8 KiB

Quantile statistics

Minimum1.24387
5-th percentile1.27579
Q11.294815
median1.31118
Q31.322365
95-th percentile1.380335
Maximum1.45328
Range0.20941
Interquartile range (IQR)0.02755

Descriptive statistics

Standard deviation0.03144324337
Coefficient of variation (CV)0.0239228281
Kurtosis4.231053884
Mean1.314361464
Median Absolute Deviation (MAD)0.01358
Skewness1.774095844
Sum2827.19151
Variance0.0009886775538
Histogram with fixed size bins (bins=10)
ValueCountFrequency (%) 
1.3114160.3%
 
1.3105650.2%
 
1.3153840.2%
 
1.314240.2%
 
1.3101940.2%
 
1.3012240.2%
 
1.3144140.2%
 
1.3199940.2%
 
1.3152140.2%
 
1.3031240.2%
 
Other values (1798)210898.0%
 
ValueCountFrequency (%) 
1.243871< 0.1%
 
1.248471< 0.1%
 
1.248811< 0.1%
 
1.249921< 0.1%
 
1.266031< 0.1%
 
ValueCountFrequency (%) 
1.453281< 0.1%
 
1.448931< 0.1%
 
1.447871< 0.1%
 
1.446631< 0.1%
 
1.446221< 0.1%
 

longitude
Real number (ℝ≥0)

Distinct count1877
Unique (%)87.3%
Missing0
Missing (%)0.0%
Infinite0
Infinite (%)0.0%
Mean103.84950771269177
Minimum103.68536
Maximum103.96751
Zeros0
Zeros (%)0.0%
Memory size16.8 KiB

Quantile statistics

Minimum103.68536
5-th percentile103.767365
Q1103.83471
median103.85025
Q3103.867015
95-th percentile103.909515
Maximum103.96751
Range0.28215
Interquartile range (IQR)0.032305

Descriptive statistics

Standard deviation0.03948268343
Coefficient of variation (CV)0.0003801913394
Kurtosis2.156138436
Mean103.8495077
Median Absolute Deviation (MAD)0.01567
Skewness-0.7331024797
Sum223380.2911
Variance0.001558882291
Histogram with fixed size bins (bins=10)
ValueCountFrequency (%) 
103.8533740.2%
 
103.8536640.2%
 
103.8450340.2%
 
103.8322630.1%
 
103.8614330.1%
 
103.8336530.1%
 
103.8331530.1%
 
103.8428130.1%
 
103.8780830.1%
 
103.8545230.1%
 
Other values (1867)211898.5%
 
ValueCountFrequency (%) 
103.685361< 0.1%
 
103.691031< 0.1%
 
103.694381< 0.1%
 
103.697461< 0.1%
 
103.698941< 0.1%
 
ValueCountFrequency (%) 
103.967511< 0.1%
 
103.967241< 0.1%
 
103.966051< 0.1%
 
103.961121< 0.1%
 
103.960731< 0.1%
 

room_type
Categorical

Distinct count3
Unique (%)0.1%
Missing0
Missing (%)0.0%
Memory size16.8 KiB
Entire home/apt
1265
Private room
799
Shared room
 
87
ValueCountFrequency (%) 
Entire home/apt126558.8%
 
Private room79937.1%
 
Shared room874.0%
 

Length

Max length15
Median length15
Mean length13.72384937
Min length11

price
Real number (ℝ≥0)

Distinct count254
Unique (%)11.8%
Missing0
Missing (%)0.0%
Infinite0
Infinite (%)0.0%
Mean172.8847047884705
Minimum15
Maximum999
Zeros0
Zeros (%)0.0%
Memory size16.8 KiB

Quantile statistics

Minimum15
5-th percentile37
Q185
median140
Q3225
95-th percentile400
Maximum999
Range984
Interquartile range (IQR)140

Descriptive statistics

Standard deviation131.0531286
Coefficient of variation (CV)0.7580377267
Kurtosis6.624034983
Mean172.8847048
Median Absolute Deviation (MAD)65
Skewness2.132478563
Sum371875
Variance17174.92251
Histogram with fixed size bins (bins=10)
ValueCountFrequency (%) 
131632.9%
 
287522.4%
 
200512.4%
 
150492.3%
 
100482.2%
 
69401.9%
 
60391.8%
 
181391.8%
 
137371.7%
 
300371.7%
 
Other values (244)169678.8%
 
ValueCountFrequency (%) 
151< 0.1%
 
1970.3%
 
2140.2%
 
2270.3%
 
2480.4%
 
ValueCountFrequency (%) 
9991< 0.1%
 
9501< 0.1%
 
90020.1%
 
8901< 0.1%
 
8811< 0.1%
 

minimum_nights
Real number (ℝ≥0)

Distinct count64
Unique (%)3.0%
Missing0
Missing (%)0.0%
Infinite0
Infinite (%)0.0%
Mean31.394235239423523
Minimum1
Maximum1000
Zeros0
Zeros (%)0.0%
Memory size16.8 KiB

Quantile statistics

Minimum1
5-th percentile1
Q12
median7
Q330
95-th percentile120
Maximum1000
Range999
Interquartile range (IQR)28

Descriptive statistics

Standard deviation57.75354087
Coefficient of variation (CV)1.839622479
Kurtosis46.26420689
Mean31.39423524
Median Absolute Deviation (MAD)6
Skewness4.76447256
Sum67529
Variance3335.471483
Histogram with fixed size bins (bins=10)
ValueCountFrequency (%) 
137717.5%
 
335916.7%
 
9023410.9%
 
301999.3%
 
21768.2%
 
71255.8%
 
5904.2%
 
18723.3%
 
180643.0%
 
20542.5%
 
Other values (54)40118.6%
 
ValueCountFrequency (%) 
137717.5%
 
21768.2%
 
335916.7%
 
4241.1%
 
5904.2%
 
ValueCountFrequency (%) 
10001< 0.1%
 
365180.8%
 
36020.1%
 
2401< 0.1%
 
2101< 0.1%
 

number_of_reviews
Boolean

CONSTANT
REJECTED

Distinct count1
Unique (%)< 0.1%
Missing0
Missing (%)0.0%
Memory size16.8 KiB
0
2151
ValueCountFrequency (%) 
02151100.0%
 

last_review
Unsupported

MISSING
REJECTED
UNSUPPORTED

Missing2151
Missing (%)100.0%
Memory size16.9 KiB

reviews_per_month
Unsupported

MISSING
REJECTED
UNSUPPORTED

Missing2151
Missing (%)100.0%
Memory size16.9 KiB

calculated_host_listings_count
Real number (ℝ≥0)

Distinct count55
Unique (%)2.6%
Missing0
Missing (%)0.0%
Infinite0
Infinite (%)0.0%
Mean59.88656438865644
Minimum1
Maximum274
Zeros0
Zeros (%)0.0%
Memory size16.8 KiB

Quantile statistics

Minimum1
5-th percentile1
Q13
median31
Q379
95-th percentile274
Maximum274
Range273
Interquartile range (IQR)76

Descriptive statistics

Standard deviation72.44267123
Coefficient of variation (CV)1.209664838
Kurtosis1.721529031
Mean59.88656439
Median Absolute Deviation (MAD)30
Skewness1.520368878
Sum128816
Variance5247.940615
Histogram with fixed size bins (bins=10)
ValueCountFrequency (%) 
138417.9%
 
21185.5%
 
2741095.1%
 
1571085.0%
 
67823.8%
 
45793.7%
 
113743.4%
 
3743.4%
 
203683.2%
 
79663.1%
 
Other values (45)98946.0%
 
ValueCountFrequency (%) 
138417.9%
 
21185.5%
 
3743.4%
 
4401.9%
 
5341.6%
 
ValueCountFrequency (%) 
2741095.1%
 
203683.2%
 
1571085.0%
 
141241.1%
 
114422.0%
 

availability_365
Real number (ℝ≥0)

Distinct count286
Unique (%)13.3%
Missing0
Missing (%)0.0%
Infinite0
Infinite (%)0.0%
Mean282.465829846583
Minimum1
Maximum365
Zeros0
Zeros (%)0.0%
Memory size16.8 KiB

Quantile statistics

Minimum1
5-th percentile48
Q1228.5
median342
Q3364
95-th percentile365
Maximum365
Range364
Interquartile range (IQR)135.5

Descriptive statistics

Standard deviation110.4890255
Coefficient of variation (CV)0.3911589079
Kurtosis-0.06903189666
Mean282.4658298
Median Absolute Deviation (MAD)23
Skewness-1.175105108
Sum607584
Variance12207.82476
Histogram with fixed size bins (bins=10)
ValueCountFrequency (%) 
36549923.2%
 
3642029.4%
 
362602.8%
 
363522.4%
 
358462.1%
 
180321.5%
 
359291.3%
 
179291.3%
 
332251.2%
 
90231.1%
 
Other values (276)115453.6%
 
ValueCountFrequency (%) 
150.2%
 
240.2%
 
330.1%
 
440.2%
 
520.1%
 
ValueCountFrequency (%) 
36549923.2%
 
3642029.4%
 
363522.4%
 
362602.8%
 
361211.0%
 

price_range
Categorical

Distinct count19
Unique (%)0.9%
Missing1
Missing (%)< 0.1%
Memory size2.9 KiB
150
493
100
439
200
357
50
255
300
216
Other values (14)
390
ValueCountFrequency (%) 
15049322.9%
 
10043920.4%
 
20035716.6%
 
5025511.9%
 
30021610.0%
 
2501898.8%
 
350673.1%
 
400301.4%
 
450180.8%
 
500180.8%
 
Other values (9)683.2%
 

Length

Max length5
Median length5
Mean length4.880520688
Min length3

Interactions

Correlations

Pearson's r

The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.

To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.

Spearman's ρ

The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.

To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.

Kendall's τ

Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.

To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.

Phik (φk)

Phik (φk) is a new and practical correlation coefficient that works consistently between categorical, ordinal and interval variables, captures non-linear dependency and reverts to the Pearson correlation coefficient in case of a bivariate normal input distribution. There is extensive documentation available here.

Cramér's V (φc)

Cramér's V is an association measure for nominal random variables. The coefficient ranges from 0 to 1, with 0 indicating independence and 1 indicating perfect association. The empirical estimators used for Cramér's V have been proved to be biased, even for large samples. We use a bias-corrected measure that has been proposed by Bergsma in 2013 that can be found here.

Missing values

Sample

First rows

df_indexidnamehost_idhost_nameneighbourhood_groupneighbourhoodlatitudelongituderoom_typepriceminimum_nightsnumber_of_reviewslast_reviewreviews_per_monthcalculated_host_listings_countavailability_365price_range
018355955Double room in an Authentic Peranakan Shophouse1759905AreshaCentral RegionGeylang1.31420103.90232Private room81900NaNNaN1173100
123481789Master Bedroom in Newly Built Flat2386154SusanEast RegionTampines1.34816103.93238Private room371800NaNNaN136550
226642660BEST CITY LIVING WITH GA RESIDENCE3212572RogerCentral RegionRochor1.30109103.85234Private room1671800NaNNaN1365200
329733863Homestay at Serangoon3824517ShirlnetNorth-East RegionSerangoon1.36743103.87288Private room261800NaNNaN136550
436768313Common Room for rent immediate4053150ImmellymelNorth-East RegionPunggol1.39963103.90640Private room16710NaNNaN1365200
537782227Cosy, bright, tasefully furnished4125828JennyCentral RegionQueenstown1.28342103.78585Private room12830NaNNaN1365150
643823571Apartment away from town4177147TaniaEast RegionBedok1.31313103.91479Private room27810NaNNaN1365300
7468808461 bedrm Aptm by Farrer Park Mrt4659563GinCentral RegionKallang1.31357103.85731Private room1003650NaNNaN1365100
8821562453Deluxe Quad-sharing room8270362DomusCentral RegionNovena1.32359103.84980Private room311080NaNNaN136550
9831581224Life Impact Coaching8408341GerardCentral RegionKallang1.31118103.87367Entire home/apt131140NaNNaN1365150

Last rows

df_indexidnamehost_idhost_nameneighbourhood_groupneighbourhoodlatitudelongituderoom_typepriceminimum_nightsnumber_of_reviewslast_reviewreviews_per_monthcalculated_host_listings_countavailability_365price_range
2141789738092051New Small Room @Orchard/Somerset/Central Area262337792HermanCentral RegionRiver Valley1.29482103.83809Private room4090NaNNaN1125850
2142789838092142Well connected 2 bedroom 2 bathroom apartment !223622603TanyaCentral RegionRochor1.30082103.84956Entire home/apt20020NaNNaN4347200
2143789938094671SMALL ROOM FOR ONE @SOMERSET/ORCHARD/CENTRAL AREA262337792HermanCentral RegionRiver Valley1.29369103.83768Private room3370NaNNaN1135950
2144790038102097环境优雅的公寓286260560BoWest RegionBukit Batok1.35654103.76028Private room9030NaNNaN183100
21457901381049712 PAX LOFT Close To Kent Ridge Park278109833BelleCentral RegionQueenstown1.27973103.78751Entire home/apt10030NaNNaN3161100
2146790238105126Loft 2 pax near Haw Par / Pasir Panjang. Free Wifi278109833BelleCentral RegionQueenstown1.27973103.78751Entire home/apt10030NaNNaN3161100
21477903381082733bedroom luxury at Orchard238891646NehaCentral RegionTanglin1.29269103.82623Entire home/apt55060NaNNaN34365550
2148790438109336[ Farrer Park ] New City Fringe CBD Mins to MRT281448565MindyCentral RegionKallang1.31286103.85996Private room58300NaNNaN3173100
2149790538110493Cheap Master Room in Central of Singapore243835202HuangCentral RegionRiver Valley1.29543103.83801Private room56140NaNNaN230100
2150790638112762Amazing room with private bathroom walk to Orchard28788520TerenceCentral RegionRiver Valley1.29672103.83325Private room65900NaNNaN7365100